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Abstract 

A fc-wise independent distribution on n bits is a joint distribution 
of the bits such that each k of them are independent. In this paper 
we consider fc-wise independent distributions with identical marginals, 
each bit has probability p to be 1. We address the following question: 
how high can the probability that all the bits are 1 be, for such a 
distribution? For a wide range of the parameters n, k and p we find 
an explicit lower bound for this probability which matches an upper 
bound given by Benjamini et al., up to multiplicative factors of lower 
order. The question we investigate can be seen as a relaxation of 
a major open problem in error-correcting codes theory, namely, how 
large can a linear error correcting code with given parameters be? 

The question is a type of discrete moment problem, and our ap- 
proach is based on showing that bounds obtained from the theory of 
the classical moment problem provide good approximations for it. The 
main tool we use is a bound controlling the change in the expectation 
of a polynomial after small perturbation of its zeros. 
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1 Introduction 



The problem of generalized inclusion-exclusion inequalities has been consid- 
ered by many authors |B1854l [B37l [DS671 [K75l IFM [BP891 IGX901 [LN90] . 
In this problem one has n events Ai, . . . , An and the probabilities of inter- 
sections Pii^sAi for all S with IS"! <k. Given this information the goal is to 
estimate the probability of VS^^^Ai from above and from below. The classi- 
cal Bonferroni inequalities state that the odd and even partial sums of the 
inclusion-exclusion formula provide such upper and lower bounds, respec- 
tively. But in many cases these bounds are far from being sharp, in the sense 
that much tighter bounds may be deduced from the same information. 

In this paper we address a special case of this question. In our setting the 
events all have equal probability P(Aj) = p and are fc-wise independent; that 
is, P(njg5y4j) = pl'^l whenever \S\ < k. When referring to this case we shall 
use a slightly different terminology and refer to the events Ai, . . . , An as n 
bits. With this terminology we are interested in estimating the probability of 
the AND of the bits given that their joint distribution is fc-wise independent 
with identical marginals p. Besides from the simplification arising from con- 
sidering a particular case, this case is of special interest from several points 
of view. 

First, /c-wise independent distributions play a key role in the computer sci- 
ence literature where they are used for derandomization (there are many 
references, e.g. the survey |LW95j ) . Here is an example for the use of A;- wise 
independence in this context: Assume that a given efficient probabilistic al- 
gorithm A works, even when the algorithm uses pairwise independent bits 
instead of truly random bits. Since there are pairwise independent distribu- 
tions with small support, this implies that the algorithm is in fact an efficient 
deterministic algorithm. In order to prove that A indeed works with access 
to only pairwise independent bits, one needs to show that the probabilities of 
certain events (that depend on A) do not change significantly when "moving" 
to a pairwise independent distribution. 

Second, there is a strong connection between linear error correcting codes 
and /c-wise independent distributions (when p = for an integer q). Given 
a linear error-correcting code over {GF{q))^ with minimal distance d, one 
may obtain a fc-wise independent distribution with k = d — 1 and p = ^ 
by considering the dual of the code. Although by this construction one gets 
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only distributions with a certain structure, this is by far the most common 
way to construct fc-wise independent distributions. A very basic and open 
question in the theory of error correcting codes is how large can a linear 
error-correcting code be, for given n,d,q ( |MS77j . see also pY04j ). A large 
code immediately implies a large probability for the AND of the bits, hence 
investigating the maximal probability that the AND event can achieve for a 
given triplet n, k,p can be thought of as a relaxation of the error correcting 
codes question (though the questions are not equivalent, even asymptotically 
in n, as an example in |BGGP] shows). 

Third, the question has intrinsic mathematical beauty. From an analytic 
perspective, when attempting its solution one is naturally led to discrete 
analogues of classical moment problems (classical quadrature formulas). Al- 
though some investigation of such discrete moment problems exists in the 
literature [KN771 Chap. VIII] . [PSSl IBP89j . they are much less understood 
than their classical counterparts. Still, the classical theory sheds light on 
our problem and enables us to make progress on it and obtain quite precise 
answers. From a more geometric standpoint, the set of fc-wise independent 
distributions forms an interesting convex body, the structure of which we 
understand quite poorly. In this work we try to at least understand the 
projection of this body in one specific direction. 

Finally, in the case p = |, the maximal probability of the AND event is also 
the maximal probability for any fixed string of bits (roughly, 'translating' a 
distribution by a constant vector, does not 'affect' the fc-wise independence). 
In other words, for p = \ this maximal probability corresponds to the mini- 
mal min-entropy possible for a /c-wise independent distribution, which seems 
a very basic property. 

This work continues a previous work [BGGP] in which an (explicit) upper 
bound for the AND event was found (as well as some lower bounds). The 
upper bound was derived as a solution to a relaxed maximization problem 
(see Section [3]) which appears quite similar to the original problem. The 
similarity makes it natural to expect that the upper bound be quite close to 
the true maximal probability. Indeed, in this work we affirm this expectation 
in a large regime of the parameters. To describe our results let us first 
introduce some notation. 

Denote by M(n, fc,p) the maximal probability of the AND event for a fc-wise 
independent distribution on n bits with marginals p. Let also M(n, k,p) be 
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the upper bound from [BGGPj (see fl3.2p for its exact value), then 

Main Theorem 1. There exist constants Ci, C2, C3 > such that the following 
holds. Let n E N, k E N even, and < p < 1. Let N = np{l — p) — 1. 

Ifk<ci-N, then 

l^exp (-tjttJjtt] M{n,k,p) < M{n,k,p) < M{n,k,p), 



k " V ViN/k) 
where V{a) = exp (^y/\og{a) loglog(a) j . 

To understand the theorem better let us highlight some of its special cases 
(a more detailed explanation appears in Section H]). 

Corollary 1.1. There exists C > such that if k > 2 is even and N = 
np{l — p) — 1 then 

1. If k < (logA^)™ for some m > and N > No{m), then 

/\ <M{n,k,p)<CVk( , V^'- (1-1) 

CVk\2eil-p)nJ " ^ ' '^^ - \2eil-p)nJ ^ ^ 

2. Ifk< Nf^ for some < (3 < 1 and N > No{(3), then 

I k f nk \ ^^'^ ^ fc2 / j)]^ \ ^1"^ 

-e c(fc,/3) — -i- — < M{n,k,p) < CVke^^ ' 



C \2e{l-p)nJ - ^ ' '^^ - \2e{l -p)n^ 

(1-2) 

where U{k,(3) := exp{c{(3) ^/\og{k) loglog(2A;)) and c{f3) > is a con- 
stant. 

Let us compare this with known results, our main novelty is in the lower 
bounds and so we only compare these. As far as the authors are aware, the 
best known lower bounds for M{n,k,p) come from error- correcting codes 
and apply to the cases when p = ^ for a prime q. The most important 
case for applications is p = |. In this case it was known using BCH codes 
( |MS77j . [ASnnl Chapter 15]) that M(n, fc, |) > {^Y^^ and also using the 

Gilbert- Varshamov bound |MS77j that M(n, k,^) > 02 j for some 
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constants Ci, 02,03 > 0. In both cases our bound improves on the known 
asymptotic results for k = o{n), but still growing to infinity with n. 

Other cases where lower bounds were known are the cases in which P = ^ 7^ | 
for a prime q. In these cases much less is known and even for the case of 
constant k and p, the best results we are aware of are of the form M{n, k, p) > 
^-a{k,p){i+o{i)) -s^ii^QYe, except of a few cases, a{k,p) is strictly larger than [|J 
(see |DY04] for a survey of such results). For example, in the case P = ^ 
and constant A; > 7 it appears that the best known asymptotic result in n 
was M (n, k, |) > cn~^'^^''~^^^^'^ . Our results show that the correct asymptotic 
behavior for constant k and p is M(n, k,p) = 0(n"l-fc/^-l) (the case of odd k 
follows from the case of even k, see (12.31) below). 

Our main tool in proving the above theorem is the following estimate. Given 
a random variable X ~ Bm{n,p) and a polynomial / of a certain form, we 
construct a new polynomial g from / by perturbing the roots of / slightly in 
a certain way. We then wish to bound the ratio of Kg{X) to Kf{X). Such 
a bound is given by Theorem 14.41 where the question is also described more 
precisely. Our methods can be used to bound the 'change' in expectation 
for other distributions as well (see Section O for more details). We note that 
the methods used in proving the theorem can be applied to other problems 
where there are continuous analogues to discrete problems, and thus it seems 
that Theorem 14.41 might be of independent interest. 

Outline Section [2] gives a more precise description of the question we con- 
sider, and explains some useful facts about it. Section [3] describes the relaxed 
version of the problem with emphasis on its similarity to the original problem. 
Our main result is explained in Section H] where the result on polynomials 
and the reduction between them are also described. Finally, Section [5] proves 
the result on polynomials. Some open problems are presented in Section O 

2 The problem and its dual 

In this section we introduce notation for our problem and present it in more 
precise terms. We then continue to describe the dual of the problem, on 
which we shall concentrate in the following sections. Let A{n, k,p) be the set 
of all probability distributions on {0, 1}" which are /c-wise independent and 
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have identical marginals p. In other words, the distribution of (Xi, . . . ,X„) 
belongs to Ain,k,p) if i e S = 1) = pl^l for all S with \S\ < k. 
Thinking of A{n, k,p) as a body in M^", it is convex. Hence, bounding the 
probability of the event AND = {Vl<i<nXj = l} under all probability 
distributions in A{n, k,p) is the same as finding 

M{n,k,p)= max Q(AND) (2.1) 

m(n,k,p)= min Q(AND). (2.2) 

Q&A{n,k,p) 

In |BGGP] it was shown that for many choices of the parameters n, k,p we 
have m(?T,, k,p) = 0, making the bound in this direction perhaps less useful. 
In this work we concentrate on estimating M. For odd k it is shown in 
[BGGPj that 

M{n,k,p) =pM{n-l,k-l,p) (A; odd), (2.3) 
hence it is enough to consider the even case. 

A simplification of problems (12. ip and (12.21) is possible: Define the set 

A^in, k,p) C A{n, k,p) 

to be the set of symmetric distributions in A{n, k,p)] that is, the joint distri- 
bution of (Xi, . . . , X„) is in A'^{n, k,p) if it is in A{n, k,p) and (Xi, . . . , X„) 
are exchangeable. Since the AND event is symmetric, one can show that 

M{n,k,p)= max Q(AND) (2.4) 

m{n,k,p)= min Q(AND). (2.5) 

Note further that a distribution in A^{n,k,p) may be identified with the 
integer random variable S which counts the number of bits that are 1. Note 
that such an S has the following properties: 

(I) S is supported on {0,1, ... ,n}. 
(II) ES' = EX* for X ~ Bin(n,p) and 1 < i < A;. 

The converse also holds (see |BGGPj ). that is 
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Lemma 2.1. For each random variable S satisfying (J) and (//) there exists 
Q G A^{n, k,p) such that S has the distribution of the number of bits which 
are 1 under Q. 

Relying on Lemma [2?n we shall henceforth identify A^{n, k,p) with distribu- 
tions 5* satisfying (J) and (/J) above. There is a short argument given below 
showing that the distribution S achieving the maximum in fl2.4p is unique. 
Similar arguments are used in [KN77j . 

We can now think of problem (12.41) as a linear programming problem in n + 1 
variables, namely, find the maximum of F{S = n) under the constraints 
F{S = i) > for < i < n, ^2^=0 = i) = 1 and the linear conditions on 
F{S = i) given by (11) above. We shall estimate M{n,k,p) using the dual 
linear programming problem [BGGPj : 

M{n, k,p) = min EBin(n.p)P(X), (2.6) 

where is the collection of polynomials P : R — M of degree at most k 
satisfying P{i) > for i G {0, 1, . . . , n — 1} and P{n) > 1 (the d in the 
notation stands for discrete). We shall estimate M{n,k,p) from below by 
showing that for each P G V^, the above expectation is not too small. 

Note that finding an optimal polynomial for the above problem gives more 
information than just M{n, k,p). By the theorem of complementary slackness 
of linear programming, if Z is the set of zeros of an optimal polynomial in 
(12.61) then the support of the optimal distribution in (12. 4p is contained in 
Z U {n}. This can also be seen probabilistically since if P is an optimal 
polynomial, then KP{S) = M{n,k,p) for any S G A^{n,k,p) (since P is 
of degree at most k). But for any P E we have EP(5') > P(5' = n), 
hence F{S = n) = M{n, k,p) only when P{n) = 1 and all the support of S 
besides {n} is contained in the zero set of P. Of course once the support 
of the optimal S (or the zero set of an optimal polynomial) is known, the 
exact probabihties of S can be found by solving a system of linear equations. 
This system always has a unique solution (it has a Van der Monde coefficient 
matrix), which also proves the uniqueness of the distribution of S. 

Prekopa in his work ( [ P88] , see also |BP89j ) considers in more generality the 
problem of estimating F{S = n) for the class of random variables S with 
given first k moments (not necessarily those of the Binomial). He does not 
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use probabilistic language and instead writes his work in linear programming 
terminology. Adapting one of his results to our situation, it reads 

Theorem 2.2. (Prekopa IP88\ Theorem 9]) There exists an optimizing poly- 
nomial P for (12.61) of the following form. P{n) = 1 and P has k simple roots 
Zi < Z2 < ■ ■ ■ < Zk, all contained in {0, 1, . . . , n — 1}. Furthermore 

1. For even k, the roots come in pairs Zi+i = Zi + 1 for odd 1 < i < k — 1. 

2. For odd k, Zi = and the rest of the roots come in pairs Zi^i = Zi + 1 
for even 2 < i < k — 1. 

This result is also essentially contained in |KN77l Chap. VIII, sec. 3]. In 
Figures [1] and [2] we have drawn such optimizing polynomials for some choices 
of the parameters. The theorem is not so surprising when one recalls that we 
are trying to minimize the expectation of P under the positivity constraints 
of the class V^. The theorem is valid in the generality of Prekopa's work, i.e., 
the first k moments of S are given but they do not necessarily equal those of 
a Binomial random variable. 

We remark that the case in which there is more than one optimizing poly- 
nomial is the case in which some degeneracy occurs in the problem, allowing 
the optimal distribution for (12. 4p to be supported on less than k + 1 points. 

3 The relaxed problem 

As explained in the introduction, in |BGGP] an upper bound for M(n, k,p) 
was given. The bound was proven by considering a relaxed version of prob- 
lems (12. 4p and (12. 6p . In this section we describe this relaxed version (doing 
so, we follow the ideas presented in |BGGPj ). Problem (12.41) is replaced by 

M{n,k,p)= max P(5 = n), (3.1) 

where A'^{n,k,p) (here the c stands for continuous) is the set of all real 
random variables S satisfying 

(r) S is supported on [0,n]. 
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Figure 1: Optimizing polynomial 
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Figure 2: Optimizing polynomial 
in ([21]) for n = 20, = 8,p = ^. 
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Figure 3: Optimizing polynomial Figure 4: Optimizing polynomial 



in ([33D for n = 20, A; = 6,p 
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in for n = 20,k = 8,p = ^. 



(IF) ES' = EX' for X ~ Bin(n,p) and 1 < i < fc. 

Comparing conditions (I), (II) above to conditions (F), (IF) here we see that 
the only difference between the original and relaxed problems is that in the 
relaxed problem S may take non-integer values between and n. Of course 
we have the trivial inequality M{n,k,p) < M{n, k,p). In |BGGP] it was 
shown that for even k 

M(n, k,p) = ^. (3.2) 

^ ' '^^ P(Bin(n,l-p) < I) ^ ^ 

The reason that M is easier to handle than M is that the problem (13.11) is 
a special case of the Classical Moment Problem. Such problems have been 
solved, for example in the classical books |Ak65l Theorem 2.5.2], |KN77 
Chap. Ill, sec. 3.2], and a great deal of theory has been developed around 
them. 
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We now consider the dual problem to fl3.ip . which is 



M(n, k,p) = mm EBin(n,p)P(X), (3.3) 

where Vf, is the collection of polynomials P : M ^ R of degree at most k 
satisfying P{x) > for x G [0, n) and P{n) > 1 (the c stands for continuous). 
The optimizing polynomial is explicitly given in |Ak65j . it equals 1 at n and 
for even k it has | double roots in [0, n) (for odd k it has one root at and 
double roots in (0,n)). The location of the roots is given in terms of 
Krawtchouk polynomials, the orthogonal polynomials of the Binomial distri- 
bution. In Figures [3] and H] we have drawn the optimizing polynomials for 
some specific parameters. Refer to |BGGP] for more details on the optimizing 
polynomials. 

It seems worth mentioning that for even k there is another problem which is 
equivalent to the relaxed dual problem (13.31) . This other problem has been 
used by some authors to obtain similar upper bounds, sometimes without 
noting the equivalence to (I3.3p . This equivalence is also fundamental in the 
analysis of the Classical Moment Problem. The equivalent problem for even 
k is 

M(n, k,p) = min EBin(n,p)P(X), (3.4) 
Perl 

where is the collection of polynomials P : M ^ M of the form P = E? 
where P is a polynomial of degree at most | satisfying |P(^)| > 1. It is clear 
that Vl C but in fact they are equal. This follows immediately from the 
Markov-Lukacs theorem (see for example |KN77[ Chap. Ill, thm. 2.2]) 

Theorem 3.1. (Markov-Lukacs) A polynomial P of even degree is non- 
negative on [a, h] iff it is of the form 

P{x) = R\x) + {x-a){b-x)Q'^{x) (3.5) 

for some polynomials Q and R. 

4 Main result 

In this section we present our main result. Recall that M{n,k,p) stands 
for the maximal probability of the AND event under a /c-wise independent 
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distribution on n bits with marginal probability p. Recall also that M(?2, k, p) 
is given in fl3.2l) and that M{n,k,p) < M{n, k,p). Our main result is a 
lower bound for M{n,k,p) matching the bound given by M{n,k,p) up to 
multiplicative factors of lower order, in a large regime of the parameters. 
Specifically: 

Theorem 4.1. There exist constants ci, 02,03 > such that the following 
holds. Let n E N, k & N even, and < p < 1. Let N = np{l — p) — 1. 
Assume 

k<ci-N. (4.1) 

Then, 

M{n, k,p) < C3/C ■ exp (^C2 ■ ^(^' ^'P)' (4-2) 



where V{a) = exp (^y/log{a) loglog(a) 



The cases where ( 14. ip does not hold are not covered by Theorem 14.11 Some 
partial results on these cases were given in |BGGPj . For the case n(l —p) < | 
the bound < M{n, k,p) < M{n, k,p) < 2p"' was shown, and for the case 
(n — l)p < 1 it was shown that M(n, k,p) = p^. The case k = 2 was also 
solved there. 

To better understand the bound given in the theorem we present some par- 
ticular cases in the following corollary 

Corollary 4.2. There exists C > such that the following holds for all 
n, k,p as in Theorem \4.1\ Let N = np{l — p) — 1. 

1. For every m > 0, there exists Nq = NQ{m) such that if N > Nq and 
k < (logN)"^, then 

M{n, k,p) < Ck ■ M{n, k,p). 

2. For every < P < 1, there exists c(/3) > and Nq = Nq{P) such that 
ifN>No and k < , then 

M(n, k.p) < Cexp I , ^ | M(n, k,p). 

Uxp(c(/3)v/log(fc)loglog(2fc)) / 
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3. For any k satisfying (4-1), 

M{n,k,p) < Ce^^M{n,k,p). 
Proof. The proof follows by substituting the appropriate values of k. □ 

Corollary 11.11 from the Introduction section follows from the above corollary 
using the following estimates on M(n, k,p), which are proved at the end of 
the section. 

Claim 4.3. Let n G N, A; G N even, and < p < 1. There exist C, c > 
such that if k < Cn{l — p) then 

Theorem 14.11 is proved using the following general idea: Consider any poly- 
nomial P G of the form given in Prekopa's Theorem 12.21 Change the 
location of its roots slightly to make each pair of adjacent roots into one 
double root. The new perturbed polynomial P is in Show that the ex- 
pectation under the Bin(n,p) distribution of P is not much higher than that 
of P. Deduce that the expectation of the optimal polynomial in fl2.6l) is not 
much lower than the expectation of the optimal polynomial in (13. 3p . 

The actual proof that the two expectations are close is somewhat compli- 
cated. A key ingredient is the use of discrete Chebyshev polynomials to 
bound the ratio of the value of P and P at certain points. 

The result we need about polynomials is the following. Let k be even and 
fix two polynomials 

k/2 fc/2 

f{x) = Y\_{x-ai){x-ai-l) and g{x) = Y\_{x - ai)'^, (4.3) 

i=l i=l 

with all G {0, 1, . . . , n — 1} and such that ^ aj and ^ aj + 1 for i j. 

For a polynomial (p we denote En.pM = E [(/'(-^)] where X ~ Bin(n,p) has 
Binomial distribution with parameters n and p. 
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Theorem 4.4. There exist constants Ci, 02,03 > such that the following 
holds. Let n G N, /c G N even and < p < 1. Let N = np{l — p) — 1. 
Assume k < ci ■ N. Then, 

E„,p[^] < C3k ■ exp (^02 ■ Y(^jJ]^^ E„,p[/], 

where V{a) = exp (^^/\og{a) loglog(c 
The proof of Theorem 14.41 is given in Section [5] below. 



Proof of Theorem \4.1\ By Prekopa's Theorem 12.21 there exists / such that 
/ has the form given in (14.31) . and G V^. By Theorem 14.41 

for g as in (14.31) . Since G V^, 

M(n,fc,p)<^, 

which completes the proof, as g{n) > f{n). □ 

Proof of Claim We first recall that there exist 6*4,04 > such that 
c,^{iY" < (I)! < C,./k{^f\ Hence 

n \ n^l'^ 1 / 2en\ '^^^ 



and since k < Cn{l — p) (for a large enough C), we have 
k/2j - {k/2)\ - \ k ' 
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Hence 

P(Bm(n, l-p)<^)> (^^2) p'^-'^'il-p)'/' > 

/ 2e(l — 



k/2 



iVk\ pk ) 
Similarly note that since k < Cn{l — p), we have 

(;>"-'(i-P)'<i(jJp"-(i-pr' 

for i < k/2. Hence 

The claim now follows by substituting the above estimates into (13.21) . □ 

5 Perturbing Roots of Polynomials 

In this section we shall prove Theorem 14.41 For n G N, we denote /„ : = 
{0, 1, . . . , n}. For two real numbers a and b, we denote [a, b) := {t : a < t < b} 
and [a,b] := {t : a <t <b}. For given n G N and < p < 1, we define 
P„^p[x] = (") p^{l — for X G /„; i.e., the probability of x according to 

Bin(?T,,p). 

We wish to bound the ratio between E„_p [g] and E„_p [/] . We write 

^n,p[g] _ E"=oPn,pM^(x) 

The theorem then follows from the following two lemmas: 
Lemma 5.1. Let x & In be such that f{x) 7^ 0. Then 

fix) 
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Lemma 5.2. There exist universal constants Ci, 02,03 > such that the 
following holds. Let N = np{l — p) — 1. Assume k < ci ■ N. Then, for every 
X E In there exists w E In satisfying 

IPn,pNfi'(x) / 

< C3 ■ exp 02 



Pn,pM/(^) " V ViN/k) 

where V{a) = exp ( A/log(ayioglog(c 



The first of tfiese lemmas is mucli simpler tlian tlie second, and its proof is 
given in Section [5?T1 The second lemma addresses the case where f{x) = 
in which Lemma 15.11 does not apply, and is proved in Section 15.21 

We now show how Theorem 14.41 follows from the two lemmas. 



Proof of Theorem \4-4\ Let 



Zeros(/) = {y G 4 : /(y) = 0} . 

We shall denote the w that corresponds to x according to Lemma [5721 by w^- 
We write (15. ip using the above two lemmas and using the fact that for all 
X e In, fn,p[x\ > and f{x),g{x) > (due to the special structure (14.31) of 
the polynomials) as 



^uAa] < 2v^ V F[x]f{x) 

' ' n,p 

2^S/n\Zoros(/) 

+^3 ■ exp L ■ Yl £K]/K 

< (cs + 2)k.exp(^C2-y^^EnM]- 



□ 



5.1 Points that are not zeros of / 

Proof of Lemma I5.il Note that 



fe/2 
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Since f{x) ^ 0, we can partition the a^'s into two sets: 



Si = {i : tti < x} and S2 = {i : flj > x} . 



First, for each 2 G 5*2 



< 



< 1. 



(5.3) 



tti + I — X 



In addition, 



o<n 



X 



- ai-1 



k/2 ^ k/2 ^ 

sn(i+^)s2-p(E^) 




< 2 exp (- log{k - 1)) < 2Vk. 



\2 



(5.4) 



The lemma follows by substituting fl5.3p and (15.41) in (15. 2p . 



□ 



5.2 Points that are zeros of / 

In this section we prove Lemma 15.21 We first describe a family of or- 
thogonal polynomials, the discrete Chebyshev polynomials. Then we prove 
Claim [531 that uses these polynomials. Finally we use the Claim [53] to prove 
Lemma 15.21 

5.2.1 Orthogonal Polynomials 

We now give some properties of a family of orthogonal polynomials stud- 
ied by Chebyshev, sometimes called discrete Chebyshev polynomials. These 
properties are described and proved in |Sz75l Section 2.8]. 

Fix M G N. The family of polynomials {t^j^Q^ defined below are orthogonal 
polynomials for the measure which assigns mass one to each integer 
X G {0, 1, . . . , M — 1}, see (15.61) for the chosen normalization. In other words 
for every d,d' & {0, . . . , M — 1} such that d 7^ d', 



J2 td{i)td'{i) = 0. 



ie{o,...,A/-i} 
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The polynomial td is 

M.)^<;!.A<'.Q(^-/). (5.5) 

where the normalization was chosen so that 

ie{0,...,Af-l} 

Above we used the notation 

AG(x) = G{x + 1) - G{x) , A^-^^G = A [A^'^-^^G] 

and 

2;\ dcf x{x -1) ■ ■ - {x - d + 1) 



The coefficient of x'^'^ in (i! ■ (^) (^^^^) is ^. Thus, by the linearity of A, and 
since for every A; G N, 

Ax*^ = (x + 1)^ -x'' = kx^-^ + + ■ ■ ■ + 1, 

the polynomial td has degree c?, and the coefficient of x'^ in is {^^\ Thus, 
since every monic polynomial G of degree d < M can be expanded as G{x) = 
C^d) + YhZI aiU{x), we have using ([5J]) 



ie{o,...,J\/-i} ^ ^ je{o,...,A/-i} 

'2d\ M(M2 - 12)(M2 - 22) . . . (M2 - ^2) 



/ 2d+l 



Using the inequalities 1 - x > e^^^ (0 < x < i), (^^'') < 2^ (d > 1) and 
^ti^' = < rfM^^ > 1) we obtain for 1 < d < f , " 



e 



ie{o,...,M-i} \ ' J \ / 

(5.8) 

From this we deduce the following (the case = is straightforward). 
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Corollary 5.3. Let M G N and let G be a monic polynomial of degree d for 
0<d<f, then 

ie{o,...,M-i} 4^+1/2 
5.2.2 A Segment With Few Zeros 

In this section we prove an auxiliary claim, to be used in the next section 
as a main component in the proof of Lemma 15.21 The claim roughly states 
that given a segment with few zeros, we can find a point at which / obtains 
a 'large' value. 

Claim 5.4. Let x G /„, let R,m E 'N be such that m > 2R, let L be a 

non-negative integer, and let t > A. If 

I Zeros(/) n [x + m, X + rm) I < _R, (5.9) 

and 

I Zeros(/) n (a;,x + m/r) I > L, (5.10) 
then there exists w E N n[x + 2m, x + 3m] such that 
g{x) /12k 



< 8 ■ exp (^— + 6i? - L log r 



Similarly, if instead of (15. 9p and ( ]5.10p we have 

I Zeros(/) n (s — rm, a; — m] | < -R, 

and 

|Zeros(/) n (x — m/r, x)\ > L, 
then there exists w E N (1 [x — 3m, x — 2m] such that 

q(x) /'12k . \ 

<8-exp + 6i?-Llogr . 

Proof. Assume without loss of generality that (15. 9p and (I5.10p hold (a similar 
argument holds for the second case). We write 

9{x) (x - aj)^ 

/H l\{w-a,){w-a,-iy ^ • ^ 
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We partition the a^'s into five subsets Si, S2, S^, S4, according to the def- 
initions below, and bound flS.lip over each subset separately. The partition 
is 



^1 






.,k/2} 


X < ai < X + m/T} , 


^2 






.,k/2} 


X + m/r < ai < X + m or tti < x} , 


^3 


= {^ 




.,fc/2} 


X + 4m < ai < X + rm} , 


^4 






.,k/2} 


X + rm < Oj} , 


^5 






.,k/2} 


X + m < tti < X + 4m} . 



Let a; + 2m < < a; + 3m be such that f{w) 7^ 0. 
First, for every i E Si, 



< 



w — a-i 



1 



which implies 



a,; - X 



Second, for every i E S2, 



ai){w - ai-l) 



< T 



-L 



< 



which implies 



o<n 



W — Qi — 1 



{ai - xY 



< 1, 



i£S2 



Third, for every i E S3, 
Hence, since 15*31 < 

o<n 



{w — ai)(w — ttj — 1) 



< — — - < 4. 

tti — w 



< 1. 



[tti - xf 



{ai - w){ai + 1 - w) 



< 4 ■ 4^. 



(5.12) 



(5.13) 



(5.14) 
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Similarly, since 2 |S'4| < k 
{aj - 

{tti — w){ai + 1 — w) ~ \t — 3 J ~ 



. TT {fli-xf ( T fl2k\ 



Finally, define the polynomial 

F{i)'^X{{i-a,){i-a,-l). 

Denote d = 2|S'5|, the degree of F. Since 2|S'5| < i? < we deduce from 
Corollary 15.31 that there exists € N fl [x + 2m, x + 3m] such that 

|F(^„)l > ^^e-"''-'. 

Hence, since njG55('^* ~ — (4?^)'^, 

< 17 (^LZL^l! ^ < 2 . ^sR+R^/m^ < 2 . e^^. (5.16) 

.^J- (wo - ai){wo - tti - 1) 

Therefore, plugging fl5J2D . fl57[3|) . flSTHj) . flSJfSD and fl5J6D into fl5ll|) with 

w = Wo, 

g{x) „ (I2k 



fiwo) 



< 8-exp + 6i?-Llogrj. 



□ 



5.2.3 Finding good w 



The following claim shows that there exists a w that is 'close' to x on which 
/ obtains a 'large' value. 

Claim 5.5. Let x & In, k > Z & N, and t > e^"^ . Let K he the smallest 
integer such that 



logr 
6 . 



> 



k 



Then, there exist integers Wi > x and W2 < x such that for each w G 

{Wl,W2}, 



3Z < w - X < 9Zt 



K 
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and 

qix) /'12k \ 

f{w) \ T / 

Proof. We show the existence of wi, the existence of W2 can be shown simi- 
larly. 

Let Zq = Zi = Z. Let tuq = SZq and mi = titiq. Define Zi and rrii for 
i = 2, 3 ... as 

logr 



6 



Zi-2 and rrii = rrrii^i. 



Since the intervals 

[x + mo, X + mi), . . . , [x + mK,x + rriK+i) 

are disjoint, since the number of zeros of / is k, and since Z^ > k, one of 
the following holds: 

1. |Zeros(/) n [x + mo, X + mi)| < Zq. 

2. |Zeros(/) n [x + mi, X + m2)| < Zi. 

3. There exists 2 < i < K such that 

|Zeros(/) n [x + mi,x + mi+i)| < Zi, 

and 

|Zeros(/) n (x, X + m^^i) | > Zi_2- 

If either 1 or 2 holds, then by Claim [5^ with L = 0, R = Z,m = mo > 2Z 
in case 1 and m = mi > 2Z in case 2, there exists wi G N such that 

3Z < wi — X < 9Zt 

and 

g{x) ^ /12k 



< 8 • exp + 6Z^ . 
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Consider case 3, and let 2 < i < be as guaranteed by case 3. Note that 
rrii > 2Zi. Thus, by Claim [231 with L = Zi_2, R = Zi and m = mj, there 
exists G N such that 

3Z <wi-x < 9Zt^ 



and 



< 8 ■ exp ( — + QZi - Zi_2logrj < 8 • exp [—)■ 



□ 



5.2.4 Probability Estimates 

Claim 5.6. Let £ G {1, . . . , n}, < p < 1, and let N = np{l - p) - 1. 
Assume N > 0. Set fi = \j)n\ . If i < {n — /i)/2, then 

<exp — ■ P + 

n,p \ZI\ J n,p 

In addition, if i < fi/2, then 

P[/i] <exp (^) ■ P 

n,p \ I\ J n,p 

Proof. Assume that £ — 1 < (n — /i)/2. Then, 



< 



l-pV IJ,^ /v^^ 2(i-l) 



p ) {n-iif ^-/^ 
\-pV / /(£+l)(n-/i) + 2/i(£-l) 



< 



exp 



p ) in — ^ y \ 2/i(n — n) 

n + n) + 



2p{n — jj) 
f^d' f 1 

< exp 



\2n \p{l—p) — l/n 
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This proves the first assertion. For the second assertion note that 

- 2 - 2 2 

Recall that the binomial measure decreases as the distance from its expecta- 
tion increases. Thus, 

P[/i-£]= P [r2-^ + £]> P [[(l-p)nj +! + £]. 

n,p n,(l-p) n,(l-p) 

In addition, since (£ + 1) — 1 < lHiki£M^ \]iq proof of the first assertion 
implies 

P[/x] < expf-l-"] . p[;,+ i] 
which completes the proof since i > 1. □ 



5.2.5 Proof of Lemma 15.21 



Proof. Let x E In and /i = [pnj. Let k > Z E N and r > e^^, to be 
determined. Let K = K{t, Z) be the smallest integer such that 



logr 
6 . 



K-l 1 

^ k 

- 'z' 



First assume x < fi. We use Claim [531 to find w > x such that w < x + 9Zt^ 
and 



/12k \ 
< 8 ■ exp i^— + QZj . 
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Now if w < yU we certainly have Pn,p[a;] < P„,p[u']. If w > fi then we can use 
Claim [HTBl with i = w — fi<w — x< 9Zt^ , provided that i < to obtain 

< exp ' 



Thus, for any value of w, 

^nn\x]g(x) f8(9ZT^V 12k 
n,pi jyv ; ^ g . ^ ^ + + QZ 



Pn,pM/(^) " " V AT 

This also holds for x > /i, by using Claim [5751 to find w < x, and the estimate 
in Claim [576] involving P„,p[/i — i], provided that i < ^■ 

Set 

r = — exp( Vlog(Ar/A;) loglog(iV/fc)) and ^ = [- 
iUU r 

Since ci is small enough (recall that k < ci ■ N), t > e^^ and a short calcu- 
lation shows that 

^^1 / \og{N/k) 



4 y log log(iV/fc) 



Since i < 9Zt^ , this implies that i < y — { 2' ^V^} (^^'^ small enough 
ci). Thus, 

¥np\x]g(x) ( (k 

n,PL jyv ; ^ 8-exp C4 - + 1 



r 



for a constant C4 > 0, since < < 1 and Z < ^ + 1. The lemma 

follows. □ 



6 Open Problems 

1. What is the value of M{n,k,p) in the range of the parameters not 
treated by our theorem, namely k > Cnp{l — p)l 

2. What is the actual ratio of M(n, k^p) and M(n, k,p)7 
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3. Is there also a similarity between the optimal distributions of our orig- 
inal and relaxed problems (problems fl2.4p and fl3.ip )? As explained 
in Section [21 this is related to whether the optimizing polynomials in 
the dual problems are similar. As hinted by Figures [TIIH calculations 
in particular cases seem to indicate this to be the case. The similarity 
seems especially strong in the case p = \- 

4. In the setting of Theorem 14.41 What is the best ratio between ]E„p[(7] 
and E„^p[/]? I.e., the best bound on the change in the expectation of 
the polynomial after small perturbation of its zeros. 

5. Find upper and lower bounds for the maximal probability that all the 
bits are 1, for the class of almost A;-wise independent distributions. Sim- 
ilarly to fc-wise independent distributions, such distributions have also 
proven quite useful for the derandomization of algorithms in computer 
science. 

Acknowledgement. We would like to thank Itai Benjamini, Ori Gurel- 
Gurevich and Simon Litsyn for several useful discussions on this problem. 
Part of this work was conducted while the authors participated in the PCMI 
Graduate Summer School at Park City, Utah, July 2007. 
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